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Xj  Abstract 
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-WCbtudy  the  computational  complexity  of  the  discrete  versions  of  some  simple 

but  basic  decentralized  decision  problems.  These  problems  are  variations  of  the 

Jr' 

classical  team  decision  problem'  and  include  the  problem  of  decentralized  detec¬ 
tion,  whereby  a  central  processor  is  to  select  one  of  two  hypotheses,  based  on  1- 
bit  messages  from  two  non-communicating  sensors.  Our  Results  point  to  the 
inherent  difficulty  of  decentralized  decision  making  and  suggest  that  optimality 
may  be  an  elusive  goal. 
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I.  INTRODUCTION 

The  field  of  decentralized  (distributed)  decision  making  has  been  an  active 
area  of  research  for  more  than  two  decades  [4,  11,  12).  In  the  meantime,  it  has 
been  realized  that  decentralized  decision  problems  are  qualitatively  different  from 
the  corresponding  decision  problems  with  centralized  information.  The  classical 
“counterexample”  of  Witsenhausen  (5,17)  in  decentralized  stochastic  control  best 
illustrates  this  point.  It  is  safe  to  conjecture  that  the  prohibitive  factor  in  decen¬ 
tralized  problems  is  not  so  much  the  inadequacy  of  the  mathematical  tools 
presently  been  used,  but  rather  the  inherent  complexity  (in  the  broad  sense  of  the 
term)  of  the  problems  that  are  usually  been  formulated.  However,  this  ever¬ 
present  complexity  is  still  to  be  pinned  down  in  a  precise  mathematical  way. 
The  present  paper,  which  follows  the  line  of  research  of  [10),  should  be  viewed  as 
a  contribution  in  this  direction.  We  focus  on  finite  versions  of  some  simple  but 
fairly  typical  decentralized  decision  making  problems  and  characterize  their  com¬ 
plexity  by  using  the  tools  of  the  theory  of  computational  complexity  )2,9).  Keep¬ 
ing  with  the  tradition  of  this  theory,  we  consider  "easy”  those  problems  that  can 
be  solved  by  a  polynomial  algorithm,  whereas  we  consider  NP-complete  (or 
worse)  problems  to  be  “hard”.  Ir.  our  opinion,  such  an  approach  is  a)  more  satis¬ 
fying  intellectually  and  b)  given  the  present  state  of  the  theory  of  decentralized 
decision  making,  it  will  allow  us  to  sytematically  identify  hard  problems  and 
redirect  research  efforts  to  new,  easier  or  appropriately  formulated  problems. 


Overview. 
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The  main  issue  of  interest  in  decentralized  systems  may  be  loosely  phrased 
as  “who  should  communicate  to  whom,  what,  when,  etc.”.  From  a  purely  logical 
point  of  view,  however,  there  is  a  question  which  precedes  the  above:  “are  there 
any  communications  necessary”?  Section  2  addresses  the  difficulty  of  the  prob¬ 
lem  of  deciding  whether  any  communications  are  necessary,  for  a  given  decentral¬ 
ized  system.  We  use  a  formulation  of  this  problem  introduced  in  (10].  We 
impose  some  additional  structure  on  this  problem  and  we  are  able  to  determine 
the  boundary  between  easy  and  hard  cases.  In  Section  3  we  formulate  the 
discrete  version  of  the  decentralized  detection  problem  and  prove  that  it  is,  in 
general,  a  hard  one.  In  Section  4  we  present  and  discuss  a  few  problems  related 
to  the  problem  of  Section  2,  including  the  team  decision  problem.  Section  5  con¬ 
tains  our  conclusions.  AH  proofs  may  be  found  in  the  Appendix. 
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D.  A  PROBLEM  OF  SILENT  COORDINATION 
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Let  {1,  M }  be  a  set  of  processors  (decision  makers).  Each  processor  » 
obtains  an  observation  y, G  F, ,  where  K,  is  a  finite  set.  Then,  processor  *  chooses 
a  decision  «,  belonging  to  a  finite  set  U ;  of  possible  decisions,  according  to  a  rule 
w,-  =  7,(y,  ),  where  7,  is  some  function  from  Y ,•  into  The  M*tuple  (jf ) 
is  the  total  information  available  and  may  be  viewed  as  the  “state  of  the 
environment”.  For  each  state  of  the  environment,  we  assume  that  only  certain 
M-tuplos  of  decisions  accomplish  a  given,  externally  specified  goal. 

More  precisely,  for  each  (yi,— y.w)£  F, X-.-X  YM,  we  are  given  a  set 
S{9l'—>yAt)C.UiX  ■  '  '  XlfM  of  satisficing  (using  the  term  introduced  by  H. 
Simon  [13])  decisions.  So,  5  may  be  viewed  as  a  function  from  F,X  -  XT* 
into  2f  lX  *  f“ .  We  then  ask  whether  there  exist  decision  rules  7,-  :F,-  — ►  U{ 
(involving  no  communications)  which  always  lead  to  satisficing  decisions.  This 
problem  was  first  introduced  (for  the  case  A/  =  2)  in  [10]  and  may  be  formalized 
as  follows: 

Problem  DS:  Given  finite  sets  Yx,  .  .  .  ,  Fw,  U v  .  .  .  ,  VM  and  a  function 
S  :  V,X  '  '  •  X  Ym  2U'X  xl*,  are  there  functions  7 F,- —»{/,■ ,  i  =  l,...,Af, 
such  that 

('Yi(Vi).->7jf(9Afi)  €  5(y„...,y.u),  V(y,,  .  .  .  ,yM)e  F,X  X  Ym  ? 

(2.1) 

We  are  assuming  above  that  the  function  S  is  easily  computable;  for  exam¬ 
ple,  it  may  be  given  in  the  form  of  table.  Also,  note  that  the  centralized  counter¬ 
part  of  DS  would  be  to  allow  the  decision  u,  of  each  processor  depend  on  the 
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entire  set  of  observations,  in  which  case  the  problem  would  become  trivial.  Since 
DS  has  a  trivial  centralized  counterpart,  any  difficulty  inherent  in  DS  is  only 
caused  by  the  fact  that  information  is  decentralized.  In  this  sense,  DS  captures 
the  essence  of  coordinated  decentralized  decision  making  (silent  coordination). 

It  was  shown  in  (10]  that: 

a)  The  problem  DS  with  two  processors  (M  =  2)  and  restricted  to  instances  for 
which  the  cardinality  of  the  decision  sets  is  2  ( |  V;  |  =  2,  »  =  1,2)*  may  be 
solved  in  polynomial  time. 

b)  The  problem  DS  with  two  processors  (A/  —  2)  is  NP-complete  even  if  we  res¬ 
trict  to  instances  for  which  |  U{  |  =  2,  |  f/2  |  =3. 

An  extension  of  the  above  results  is  the  following: 

Proposition  2.1:  The  problem  DS  with  three  or  more  processors  (A/ >3)  is 
NP-complete,  even  if  we  restrict  to  instances  for  which  |  <7,-  |  =  2,  V  ». 

We  may  therefore  conclude  that  the  problem  DS  is,  in  general,  a  hard  com¬ 
binatorial  problem,  except  for  the  special  case  in  which  there  are  only  two  proces¬ 
sors  and  each  one  has  to  make  a  binary  decision.  It  should  be  noted  that  the 
difficulty  is  not  caused  by  an  attempt  to  optimize  with  respect  to  a  cost  function, 
because  no  cost  function  has  been  introduced.  In  game  theoretic  language,  we 
are  faced  with  a  “game  of  kind”,  rather  than  a  “game  of  degree”. 

We  now  turn  to  special  cases  of  DS,  by  introducing  some  more  structure 
(reflecting  the  nature  of  typical  practical  problems),  with  the  aim  of  determining 

•For  say  Soil*  Mt  /l ,  mt  let  |  A  |  deaotr  its  rsrdiaality. 


the  dividing  line  between  easy  and  hard  special  cases.  Moreover,  we  restrict  to 
the  case  of  only  two  processors  (A/  =  2).  (Certainly,  problems  with  A/  >  2  can¬ 
not  be  easier.) 

In  the  formulation  of  DS  that  we  introduced  earlier,  all  pairs 
i  X  r2  are  likely  to  occur.  So,  the  information  of  different  processors 
is  completely  unrelated;  their  coupling  is  caused  oijly  by  the  structure  of  the 
satisficing  sets  S(y,,y2).  In  most  practical  situations,  however,  information  is  not 
completely  unstructured:  when  processor  1  observes  yj,  he  is  often  able  to  make 
certain  inferences  about  the  value  of  the  observation  y2  of  the  other  processor 
and  exclude  certain  values.  We  now  formalize  these  ideas: 

Definition:  An  Information  Structure  /  is  a  subset  of  F,  X  We  say 
that  an  information  structure  I  has  degree  (£>|,£>2),  (Z),,£>2  are  positive 
integers)  if: 

(i)  For  each  yx  £  F,  there  exist,  at  most  £>,  distinct  elements  of  V2  such  that 

€  l- 

(ii)  For  each  y2  G  Y2  there  exist  at  most  D2  distinct  elements  of  F,  such  that 

(y  1,1/2)  €  I 

(iii)  D,,  D2  are  the  smallest  integers  satisfying  (i),  (ii). 

An  information  structure  /  is  called  classical  if  £),  =  D2  —  1;  nested  if 
£),  =  I  or  Do  =  1. 

We  now  interpret  this  definition:  The  information  structure  /  is  the  set  of 
pairs  (y,,y2)  of  observations  that  may  occur  together.  If  /  has  degree  (Z)j,D2), 


processor  1  may  use  his  observation  yx  to  decide  which  elements  of  Y2  may  have 
been  observed  by  processor  2.  In  particular,  he  may  exclude  all  elements  except 
for  (at  most)  D  j  of  them.  The  situation  faced  by  processor  2  is  symmetrical. 

If  Dx  =  I  and  processor  I  observes  yx,  there  is  only  one  possible  value  for 
y2.  So,  processor  1  knows  the  observation  of  processor  2.  (The  converse  is  true 
when  D2  =  1).  This  is  called  a  nested  information  structure  because  the  infor¬ 
mation  of  one  processor  contains  the  information  of  the  other.  When 
Dx  =  D o  =  1,  each  processor  knows  the  observation  of  the  other;  so,  their  infor¬ 
mation  is  essentially  shared. 

By  restricting  our  attention  only  to  pairs  ( ,Y2)  G  /,  we  obtain  the  follow¬ 
ing  version  of  DS: 

Problem  DSI:  Given  finite  sets  YX,Y2,UX,U2,  I  C  YxX  Y2  and  a  function 
S:I  — »  are  there  functions  -y,-  :  V,-  -»  U{,  i— 1,2,  such  that 

(nr1(yi), 72(sf2))  €  S(yx,y2),  V(y„y2)G/  ?  (2.2) 

Note  that  any  instance  of  DSI  is  equivalent  to  an  instance  of  DS  in  which 

S(Vi, y3)  =  Ux  X  U2,  \/[yx,y2)  f  /• 

That  is,  no  compatibility  restrictions  are  placed  on  the  decisions  of  the  two  pro¬ 
cessors  for  those  (yx,y2)  that  cannot  occur.  We  now  proceed  to  the  main  result  of 
this  section: 

Proposition  2.2: 

a)  The  problem  DSI  restricted  to  instances  satisfying  any  of  the  following: 
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(i)  One  or  more  of  | Ux 1 ,  |  f/2| ,  D ,,  Z?2  is  equal  to  1, 

(H)  If/,)  =  \U2\  -2, 

(iii)  D,  =  Do  =  2, 

(iv)  £>,  =  |f/2|  =2,  (orZ>2=|(/1|=2), 
may  be  solved  in  polynomial  time. 

b)  The  problem  DSI  is  NP-complete  even  if  we  restrict  to  instances  for  which 

I  U\  \  =£>,  =  3,  \U2\  =  Z)2  —  2- 

Note  that  the  above  result  draws  a  precise  boundary  between  polynomial 
and  NP-complete  special  cases,  in  terms  of  D,-,  |  f/t-  | ,  *  =  1,  2.  We  have  seen  that, 
in  general,  DSI  is  NP-complete  even  if  Z>,,  D2  are  held  fixed.  There  is,  however, 
a  special  case  of  DSI ,  with  Dx,  D2  constant,  for  which  an  efficient  algorithm  of 
the  dynamic  programming  type  if  possible: 

Proposition  2.3:  Let  Yx  =  1'2  =  {l,2,...,n}.  Let  D  be  a  positive  integer  con¬ 
stant.  Consider  those  instances  of  DSI  for  which  («,;)  £  /  implies  either 
\i-j\<D  or  \t-j  \  >n-D.  Then  DSI  may  be  solved  in  time  which  is  polyno¬ 
mial  in  n. 

A  condition  of  the  type  |  i  j  |  <  D,*J{i,j)  E  /  is  fairly  natural  in  certain 

applications.  For  example,  suppose  that  the  observations  yx  and  y2  are  noisy 

measurements  of  an  unknown  variable  x  (y.==i+  t»,-)  where  the  noises  u>,  are 

bounded:  |  tr,  |  < D /2.  Similarly,  the  condition  |i-j|<D  or  1 1 -j  |  >n-D,  V 

(*,;)E  /,  arises  if  the  observations  yx,  y2  are  noisy  measurements  of  an  unknown 

quantized  angle:  y,- ■  =  9  (mod  2 it  ),  where  the  noises  a;,-  are  again  bounded 

D/2. 
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m.  DECENTRALIZED  DETECTION. 

A  basic  problem  in  decentralized  signal  processing,  which  has  attracted 
much  attention  recently  [1,6,7,13,14,15]  is  the  decentralized  detection  (hypothesis 
testing)  problem.  In  this  section  we  consider  the  discrete  version  of  this  problem. 

Two  processors  (sensors)  5,  and  S2  receive  measurements  y,-  £  Y-,-,  * =1,2, 
where  Y,  are  finite  sets.  (Figure  3.1).  There  are  two  hypotheses  H t  and  Hx  on 
the  state  of  the  environment  with  prior  probabilities  pt  and  pu  respectively.  For 
each  hypothesis  we  are  also  given  the  joint  probability  mass  function 
P(y,,y2 1 //,)  of  the  observations,  conditioned  on  the  event  that  H{  is  true.  Upon 
receipt  of  y,-,  processor  5f  evaluates  a  binary  message  «,•  £  {0,1}  according  to  a 
rule  u,  =  *7,-(yt- ),  where  7,-:  Y,  — »0,1.  Then,  and  «2  are  transmitted  to  a  cen¬ 
tral  processor  (fusion  center)  which  evaluates  «0=rUjA  ti2  and  declares 
hypothesis  H0  to  be  true  if  u0=i 0,  //1  if  «o  =  L  (So.  we  essentially  have  a  vot¬ 
ing  scheme).  The  problem  is  to  select  the  functions  71(  72  so  as  to  minimize  the 
probability  of  accepting  the  wrong  hypothesis.  (More  general  performance  cri¬ 
teria  may  be  also  considered). 

Most  available  results  assume  that 

p  (y„y2  I  Hi)  =  P(v «  I  #.)  P(V2  I  'U  «= 1,2  (3.1) 

which  states  that  the  observations  of  the  two  processors  are  independent,  when 
conditioned  on  either  hypothesis.*  In  particular,  it  has  been  shown  [15)  that  if 
(3.1)  holds  then  the  optimal  decision  rules  7,-  are  given  in  terms  of  thresholds  for 

•Suck  *0  assumption  ii  reasoaable  ia  problem*  of  deteetioa  of  a  kaowa  «i(aal  ia  iadepeadeat  aoiee,  bat  »  typi¬ 
cally  violated  ia  problem*  of  deteetioa  of  aa  aakaowa  ilf  aaJ. 
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the  likelihood  ratio  ~~  .  The  optimal  thresholds  for  the  two  sensors  ere 

coupled  through  a  system  of  equations  which  gives  necessary  conditions  of 
optimality.  (These  equations  are  just  the  person-by-person  optimality  condi¬ 
tions).  Few  analytical  results  are  available  when  the  conditional  inependence 
assumption  is  removed  [7].  The  purpose  of  this  section  is  precisely  to  explain  this 


status  of  affairs. 


Suppose  that  (3.1)  holds  and  let  N{  denote  the  cardinality  of  Yj-.  Given  the 
results  of  [15]  there  are  only  N{  +  1  decision  rules  'y,-  which  are  candidates  for 
being  optimal.  We  may  evaluate  the  cost  associated  to  each  pair  of  candidate 
decision  rules  and  select  a  pair  with  least  cost.  This  corresponds  to  a  polynomial 
algorithm  and  shows  that  under  condition  (3.1)  decentralized  detection  is  an  easy 
problem.  Without  the  conditional  independence  assumption  (3.1),  however,  there 
is  no  guarantee  that  optimal  decision  rules  can  be  defined  in  terms  of  thresholds 
for  the  likelihood  ratio.  Accordingly,  a  solution  by  exhaustive  enumeration  could 
require  the  examination  of  as  many  as  2Nl+  N*  pairs  of  decision  rules.  One  might 
expect  that  a  substantially  faster  (i.e.  polynomial)  algorithm  is  possible.  How¬ 
ever,  the  main  result  of  this  section  (Proposition  3.1  below)  states  that  decentral¬ 
ized  detection  is  NP-complete  even  if  we  restrict  to  instances  for  which  perfect 
detection  (zero  probability  of  error)  is  possible  for  the  corresponding  centralized 
detection  problem. 

We  now  present  formally  a  suitable  version  of  the  problem: 

Decentralised  Detection  (DD):  We  are  given  finite  sets  Yj,  V'2;  a  rational 
number  K;  a  rational  probability  ma  i  function  p  :  Y,  X  Y2  — »  Q;  a  partition 
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{Aa,A,}  of  V,  X  Y 2-  Do  there  exist  %  :  — *  {0,1},  i  =1,2,  such  that 

All^)  <  K  ?  Here 

J( 71.72)  =  E  plyviti)  Tfi(yi)  ^2(^2)  + 

A. 

+  E  p(yi»y2)  (l  -  'tj(si)  Tr2(»2)l-  (3-2) 

(yi.yi)e  Ax 

Remarks: 

1.  In  the  above  definition  of  DD,  think  of  H;  as  being  the  hypothesis  that 
(y,,y2)  €  A,-.  Then  it  is  easy  to  see  that  •/(Tfj.'fe)  corresponds  to  the  proba¬ 
bility  of  error  associated  to  the  decision  rules  /y1,72.  Note  that  if  a  single  pro¬ 
cessor  knew  both  yx  and  y2  (centralized  information)  he  could  make  the 
correct  decision  with  certainty.  Consequently,  the  above  defined  problem 
corresponds  to  the  special  case  of  decentralized  detection  problems  for  which 
perfect  centralized  detection  is  possible. 

2.  If  we  let  K  =  0,  then  DD  is  a  special  case  of  problem  DS  with 
|  (/,  |  =  |  U2 1  =2  and  is  therefore  polynomially  solvable. 

Proposition  3.1:  DD  is  NP-complete. 

It  should  be  pointed  out  that  Proposition  3.1  remains  valid  if  the  problem  is 
modified  so  that  fusion  center  uses  some  other  rule  for  combining  the  messages  it 
receives  (e.g.  u0  =  («i\/  — >«2))>  or  the  combining  rule  is  unconstrained  and  the 
fusion  center  supposed  to  find  and  use  an  optimal  combining  rule. 

Let  us  now  interpret  Proposition  3.1.  Although  it  is,  in  a  sense,  a  negative 
result,  it  can  be  useful  in  suggesting  meaningful  directions  for  future  research: 
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instead  of  looking  for  efficient  exact  algorithms,  the  focus  should  be  on  approxi¬ 
mate  ones.  (In  fact,  it  is  an  interesting  research  question  whether  polynomial 
approximate  algorithms  for  DD  exist.)  Proposition  3.2  also  shows  that  any  neces¬ 
sary  conditions  to  be  developed  for  problem  DD  will  be  deficient  in  one  of  two 
respects: 

a)  Either  there  will  be  a  very  large  number  of  decision  rules  satisfying  these 
conditions, 

b)  Or,  it  will  be  hard  to  find  decision  rules  satisfying  these  conditions. 

Another  consequence  of  Proposition  3.1  is  that  optimal  decision  rules  are  not 
given,  in  general,  in  terms  of  thresholds  for  the  likelihood  ratio,  because  in  that 
case  an  efficient  algorithm  could  be  obtained.  Of  course,  this  fact  can  be  also 
verified  directly  by  constructing  appropriate  examples.  When  the  condition  (3.1) 
holds  and  decision  rules  are  given  in  terms  of  thresholds,  the  decision  rule  of  a 
processor  can  be  viewed  as  a  tentative  local  decision,  submited  to  the  fusion 
center.  In  general,  however,  optimal  decision  rules  are  not  threshold  rules  and 
this  interpretation  is  no  more  valid.  Rather  DD  should  be  viewed  as  a  problem 
of  optimal  quantization  of  the  observation  of  each  processor.  In  that  respect, 
Proposition  3.1  is  reminiscent  of  the  result  of  [3),  namely  that  the  general  prob¬ 
lem  of  minimum  distortion  quantization  is  NP-compiete. 


i 


IV.  RELATED  PROBLEMS. 


/3 


The  best  known  static  decentralized  problem  is  the  team  decision  problem 
[8 , 1 1 J  which  admits  an  easy  and  elegant  solution  under  linear  quadratic  assump¬ 
tions.  Its  discrete  version  is  the  following: 

Team  Decision  Problem  (TDP):  Given  finite  sets  Yx,  Y2,  Ux,  U2,  a  rational 
probability  mass  function  p:YxXY2~*Q  and  an  integer  cost  function 
c:YxxY2X  U Xx  U2-*N ,  find  decision  j  'les  7,-:Y,— ►  l/,-,  * =1,2,  which  minimize 
the  expected  cost 

=  £  £  c(yi>y2.'/i(yi).'r2(y2))  p(y  1^2) 

Ji€^i  giEYi 

Another  problem  related  to  DS  is  the  following: 

Maximize  Probability  of  Satificing  (MPS):  Given  finite  sets  Yx,  Y2,  Ux, 
U  o,  a  probability  mass  function  p:YxxY2-*Q  and  a  function 
S:YxX  Y2-*2V'xUt,  find  decision  rules  7,:  Yj *=1,2,  which  maximize 

All, 12)  =  72(j/2))  €  S(yx,y2)) 

(which  is  the  probability  of  making  a  satisfactory  decision). 

Given  an  instance  of  TDP,  let 

s(Vhy2)  =  {(«i.«2)  e(yi.!t2>ui>u2)=°}- 
If  we  solve  TDP,  we  also  effectively  answer  the  question  whether  J{ 7,,72)=0. 

But  this  is  equivalent  to  solving  the  instance  of  DS  associated  to  the  above 

definition  of  S(y,,y2).  Therefore,  TDP  cannot  be  easier  than  DS.  The  same 

argument  is  also  valid  for  MPS.  It  then  follows  from  Proposition  2.2  that  TDP 
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and  MI’S  are  NIMiard  (that  is,  NP-compiete  or  worse)  even  if  we  restrict  to 
instances  for  which  |  {/,  |  =2,  1 f/2  j  =3.  However,  even  more  is  true:  it  suffices  to 
notice  that  the  problem  DD  of  the  previous  section  is  a  special  case  of  both  TDP 
and  MPS,  with  |  b\  |  =  j  U2  |  =2.  Using  Proposition  3.2,  we  obtain: 

Corollary  4.1:  TDP  and  MPS  are  NP-hard  even  if  we  restrict  to  instances  for 
which  |  Ul  |  =  |  f/2 1  =2.  This  is  true  even  if  the  cost  function  c  associated  to 
TDP  is  restricted  to  take  only  the  values  0  and  1. 

These  results  show  that  unlike  the  linear  quadratic  case,  the  team  decision 
problem  is,  in  general,  a  hard  combinatorial  problem. 
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Proof  of  Proposition  2.1:  We  will  reduce  to  DS  (with  |  V  (  =  2,  M  —  3) 
the  satisfiability  problem  of  propositional  calculus  with  three  literals  per  clause 
(3SAT)  which  is  a  known  NP-complete  problem  [2).  Given  an  instance  of  3SAT, 
let  V  be  the  set  of  literals,  C  the  set  of  clauses.  We  construct  an  instance  of 
DS  as  follows:  let 

>;  =  {1,2,...,  \V\)t  *7,  =  {0,1},  i  =  1,2,3. 

Let 

S(k,k,k)  =  {(0,0,0),  (1,1,1)},  k  =  l,...,\V\. 

Finally,  we  interpret  each  clause  in  C  as  stating  that  a  certain  triple  of  deci¬ 
sions  is  not  in  the  satisficing  set.  (For  example,  the  clause  (x,  \/  ~>Xj  \l  xk), 
translates  to  the  statement  that  the  triple  of  decisions  (0,1,0)  does  not  belong  to 
S(i,j,k).)  It  is  then  easy  to  see  that  a  satisfying  assignment  for  the  variables  in 
V  exists  if  and  only  if  the  above  constructed  instance  of  DS  is  a  YES  instance. 
□ 
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Proof  of  Proposition  2.2:  a) 

(i)  If  U i  =  \  or  U2  =  1,  the  problem  is  trivial.  If  D2  —  1,  a  satisficing 
decision  rule  exists  if  and  only  if 


D  My  iGY,, 

{yi-  (Vi.Vs)  €  /} 


where  ^(u^tin)  The  above  condition  can  be  clearly  tested  in  polynomial 

time  (in  fact  0(  |  |  |  ^2 1 )  time). 


1 


1 


(«)  This  is  the  result  of  [10]  mentioned  in  Section  2. 

(iii)  Possibly  by  renaming,  let  Y s  be  disjoint  sets.  Consider  the  graph 
C  =  (V|UV2,/).  (Here  Y,  U  Y<>  is  the  set  of  nodes,  1  the  set  of  undirected 
edges.)  Since  /),  =  Z>2  =  2,  each  node  of  G  has  degree  at  most  2.  Therefore, 
the  connected  components  of  G  are  either  isolated  nodes,  chains  or  cycles. 
Each  connected  component  of  G  defines  a  subproblem  and  these  subproblems 
are  decoupled.  So,  without  loss  of  generality,  we  may  assume  that  G  consists 
of  a  single  connected  component.  We  may  also  assume  that  G  is  a  cycle  (Fig. 
A.!).  (If  i<  is  a  chain  we  can  introduce  an  additional  edge  to  make  it  a  cycle;  this 
will  not  make  the  problem  any  easier  because  a  new  edge  simply  allows  the  pres¬ 
ence  of  some  more  constraints.)  In  that  case  Y'|  and  V2  have  the  same  number 
n  of  elements.  Possibly  by  renumbering  (see  Fig.  A.l)  we  may  assume  that 

/  =  {(,..)  I  =  1 . n}  U  { ( * .  *  D  «'  =  2,...,n  }  U  {(l.n)} 

I.et  us  define 

^(I.n  1)  =  |(b,.h»  ,)€f’,Xf72:  t  5  such  that 

(«,<-«)  €  5(n,n),  («„,«»_,)  €  S(n,n-1),  («,,0  €  5( l.n ) 

and  note  that  5(1, nl)  1  valuated  in  0(  |  ^/,  |2|  f  '2|2)  time.  We  now 

have. 

Ai.  instance  of  DSI  is  a  “YE.V  instance 

l(U|,  a j  ,  ...,  un,  u^)  [(«,,  «/)€  S  («.'),  »  =  I . " 


(«,,  H;-i)  €  S  «  =  2 ,...,«  and 

(«j-  «»)  €  5(l,n)J  t==$ 

3(«j,  uj  ,  u'n_x )[(«,,  «,' )  e  5  («,«),  »  =  and 

i  =  2,...,n-l  and  (a,,  )  €  S'  (l,n-l)  J 

The  last  expression  corresponds  to  a  new  instance  of  DS/  in  which  n  has  been 
replaced  by  n-1.  Proceeding  in  the  same  way,  the  problem  will  be  solved  after 
at  most  n  similar  stages.  This  is  essentially  an  algorithm  of  the  dynamic  pro¬ 
gramming  type,  with  complexity  OOP,  |  |  Ux  |2  |  f/2l2)- 

Remark:  In  fact  an  0{  |  y  ,  |  |(/||  (  U2\  ( |  Ux  |  +  |  f/2| ))  solution  is  possible, 
if  at  each  stage  of  the  dynamic  programming  algorithm  we  only  eliminate  one  - 
rather  than  two  -  variables.  Also,  if  G  is  a  chain,  an  0(  |  Yx  |  |  Vx  \  \  U2 1 ) 
algorithm  is  obtained  along  the  same  lines. 

(iv)  We  now  suppose  that  Dx  =  |  U2\  =  2.  Let  Yx  =  {I,...,m}, 
{!)•••)”  }  and  assume,  without  loss  of  generality,  that  for  each  it  6  K,  there 
exist  exactly  two  distinct  elements  »,  ;  of  Y2  such  that  (k,i)  £  /,  (it,;)  £  /. 

Note  that  we  have  a  ”YES”  instance  of  DSI  if  and  only  if 

•,t'w6t/|M*.«)G/  [(»*,«, )€S(fc,.')]. 

(A.l) 

Consider  also  the  statement 


tl 


f 


I 


ff/t  ;\ 


3«, . «n€i/2Mi,j)eroxv2  v*gv,  jp.oe/A  (*,»g/A  «yy] 

[(»*,«,)  G  $(*,«)  A  («*,«;)  G  S(k,j) ]] 

which  is  equivalent  to 


3«,.  .  .  .  ,  w»G^o  V( » ,j )G  V2X  v2  l( «i.«,-)€5f («,»]• 


where 


3f,(»j)=*|«V)€l/2Xl/a:ViGV1  [((*,«')€/  A  (*,»€/  A  «V  j]  => 


J^G^j  [(e*, «)€$(*, t)  A  K,«')G  S(*,») 


If  (A.l)  holds,  then  it  is  easy  to  see  that  (A.2)  holds,  as  well,  with  the  same 
assignment  of  values  to  Conversely,  assume  that  (A.2)  holds.  For  each  k, 

there  exists  only  one  pair  (i,j)  such  that  the  condition  ((fc,i)G/j  A  [(*,.? )G  I\  A 
((»yj)J  holds.  Accordingly,  for  each  k,  the  clause  ((»*,«,)  G  -S'  ( Ar , * )  A 
( t>* , «y  )G 5 ( it ,j )]  needs  to  be  checked  only  for  one  pair  (i,j).  Therefore,  for  each 
k,  a  value  of  vk  which  mal.es  (A.2)  true  can  be  chosen  regardless  of  (i,j)  and  this 
value  makes  (A.l)  true  as  well. 

Therefore,  we  only  need  to  show  that  the  truth  of  (A.2)  can  be  decided  in 
polynomial  time.  Note  that,  for  each  (i,j),  the  set  S' (i,j)  defined  by  (A.4)  may 
be  constructed  in  time  0(|1||  |f/j|).  Moreover  there  are  at  most 
min  {  |  T2|2,  |  y(|  }  pairs  to  be  considered;  so  the  sets  may  be  con¬ 

structed  in  time  0(  |  Tj|  |  j  |  min(  J  Y2  |2,|  Ti  |  }).  Once  5*  (ij)  is  con¬ 
structed,  the  statement  (u,-,u;)G  S'(i,j)  may  be  expressed  as  a  set  of  clauses 
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with  two  literals  per  clause  (the  literals  are  the  boolean  variables  this  is 

similar  to  the  proof  of  part  (ii),  see  (10]  ).  Therefore,  deciding  the  truth  of  (A.3) 
is  a  special  case  of  the  satisfiability  problem  of  propositional  calculus  with  two 
literals  per  clause  (2SAT),  which  can  be  solved  in  linear  time  [2]. 
b)  Consider  the  following  restricted  version  of  the  satisfiability  problem  for 
propositional  calculus  with  3  literals  per  clause  (3SAT).  An  instance  of  this  res¬ 
tricted  problem  (which  we  call  RSAT)  consists  of  the  following:  a  set  of  boolean 
variables  F  =  Fx  U  F 2,  where 

F\  —  { Vi]  '■  *  =  ;  j  =  1,2,3},  F2  =  {*,•  :  »  =  l,...,n};  also  a  set  of  clauses 

C  consisting  of: 

(a)  one  clause  for  each  »'  between  1  and  m,  stating  that  exactly  one  of  the  vari¬ 
ables  y,|,  yi2,  yi3  is  true  and 

(b)  an  arbitrary  number  of  clauses  of  the  form  (-»y,;V  ik)  or  (""jfyV  It  was 

shown  in  [10]  that  RSAT  is  NP-complete  and  that  RSAT  is  equivalent  to  DS 
with  |  Ul  |=3,  |  U2 1=2.  It  will  be  useful  to  point  out  the  reasons  for  the  latter 
fact:  think  of  the  observation  sets  T,  and  Y2  as  being  equal  to  {l,...,m}  and 
{l,...,n},  respectively.  Which  of  the  variables  y, \,Vi2,Va  ‘s  determines 

whether  -7,(1)  is  equal  to  1,2,3;  similarly,  the  value  of  xk  determines  whether  ^(k) 
is  0  or  1.  Finally,  a  clause  of  the  form  (“>y,y\/  x*)  would  indicate  that  a  certain 
pair  of  decisions  is  incompatible,  i.e.  docs  not  belong  to  S(i,k). 

Let  us  now  introduce  a  graph  with  nodes  Fi\JF2  and  edges 


/  =  {[i,k)  :  I  j  such  that  (->y,y\/  xt)  €  C  or  (->jr,y  V  -<xk)  €  C). 

From  this  graph  we  may  obtain  a  new  one  by  lumping  together  (for  each 
i  €  {l,...,n})  the  three  nodes  ytl,  y{2,  y,3  into  one  node  y,.  Let  //,  (respectively 
//2)  be  the  maximum  degree  of  nodes  of  type  y,-  (respectively  x4)  in  this  new 
graph. 

We  have  indicated  above  a  one-to-one  correspondence  between  instances  of 
DS  and  RSAT .  With  this  correspondence,  it  is  not  hard  to  see  that  if  we  have 
an  instance  of  DS  of  degree  ( £> i, then  the  numbers  //(,  //2  obtained  from  the 
sociated  instance  of  RSAT  are  actually  equal  to  DX,D2,  respectively.  (The  con¬ 
verse  is  also  true.) 

For  this  reason,  it  only  remains  to  prove  the  following: 

Lemma  A.l:  RSAT  is  NP-completc,  even  if  it  is  restricted  to  instances  for 
which  // j  =  3,  //2  =  2. 

Proof:  Given  that  RSAT  is  NP-complete  [10),  it  is  sufficient  to  start  with  a  gen¬ 
eral  instance  of  RSAT  and  reduce  it  to  a  new  instance  for  which  // 1  =  3, 
//2  =  2  holds.  This  is  accomplished  by  creating  multiple  copies  of  each  variable 
so  that,  instead  of  having  the  same  variable  appear  in  many  clauses,  distinct 
copies  of  it  are  used.  Of  course,  some  clauses  will  be  needed  to  create  the  multi¬ 
ple  copies  but  these  can  be  kept  to  a  small  number.  The  idea  of  the  proof  is  best 
shown  diagramatically,  as  in  Figure  A. 2.  (A  more  formal  argument  may  be  found 
in  jiO)  but  the  present  one  is  easier  to  visualise.) 

Let  y,|,  y,-2,  jvj  be  variables  in  a  given  instance  of  RSAT.  We  introduce 


some  new  z- variables,  as  well  as  some  clauses  which  guarantee,  for  example  (see 


Fig.  A.2),  that  2,=ytl,  22=y,2>  23=26—  27=2io==!fi3-  (F°r  example,  the  clauses 

("^d  V  ~12j)  A  (->25  V  ->23)  A  (  *2q  V  23), 

together  with  a  requirement  that  exactly  one  of  the  variables  24,25,26  is  true, 
implies  23=28.)*  In  this  way  we  can  effectively  create  an  arbitrary  number  of 
copies  of  the  y-variables  and  the  same  procedure  works  for  the  x-variables  as 
well.  Note  that  in  doing  so,  we  have  respected  the  requirement  —  3,  //2  =  2. 
Finally,  for  each  clause  in  the  original  instance  of  RSAT,  we  may  introduce  a 
clause  involving  appropriate  copies  and  it  is  easy  to  see  that  the  requirement 
//j  =  3,  //2  =  2  will  be  still  respected,  as  long  as  we  use  a  different  copy  each 
time.  Moreover,  since  an  arbitrary  number  of  copies  may  be  created  by  the 
above  procedure,  an  arbitrary  number  of  clauses  for  the  original  instance  of 
RSAT  may  be  thus  handled.  □ 

Proof  of  Proposition  2.3:  This  proof  is  effectively  a  generalization  of  the 
dynamic  programming  argument  in  the  proof  of  part  (a)  (iii)  of  Proposition  2.2. 
Let  us  assume  that  n  >  2D.  For  any  k  such  that  2D  <  k  <  n,  let 

r(*)=  Vk)  €  (t/i  X  V2)2D  : 

3  («D+1,»P+|,  ,«*-!>, v*-p)  €  (Ux  X  V2)hW  such  that 


•  Tht  mi  ia  Fifare  A.J  indicate  the  variable!  that  have  a  commoa  claaae;  tolid  tine*  iadicate  that  two  van* 
abtea  are  coart  raiaed  to  be  eqaal;  a  carve  eacircliaf  a  triple  of  variablei  ia  F  j  iadicatea  that  tbeae  an  to  be 
merjed  to  a  <ia|t*  aode. 


(«,,  Vj)  e  s(i,j),  V(«j)  g  {i,  ~,k}~  n  / 

Note  that  V(k)  is  of  size  at  most  |  Ux  |  2D  |  U2  |  20 ■  Now  assume  that 
2D  <  k  <  n-l  and  let 

f(Ar+l)=  ^ullvl,u2,v2,...,uD,vD,uk_D+l,vk_D+l,...,uk+l<vk+l)  e(Ut  X  U2fD+2  : 
3  («o+  bvD+  i ,  ~,»k-D’vk-D)  G  iui  X  ^a)*'20  such  that 

(«.,»/)  g  s(U),  v («,i)  e  i}2  n  / 

Using  the  assumption  |  i-j  |  <  £),  or  |  i-j  (  >n-D,  V  (t,;)  6  /,  we  can 
see  that 

i}2n  /  c  ({i,...,*}2n  /)lm*+1 

where 

Ak+l  =  .,D,  k-D+l,...,  *+l}2  . 

With  this  observation,  F(£+  1)  may  be  rewritten  as 


f(*+l)  = 

■>nD’VD>uk-D+  J >vk-Dr  l >  -  tuk+  J>v*+  l)  G  (^1  *  U2)W+2  ■ 
iul,vi,u2,v2,...,uD,vD,uk_D+  ,,»fc_p+  i,...,uk,vK)  e  r  ( k )  and 

(«,,»/)  G  5(i',»,V(ij)€  At+,  | 

Assuming  that  the  set  T(Jfc)  has  teen  computed,  we  may  use  it  to  evaluate 
T  ( k+  1)  as  follows:  for  each  clement  of  T(t)  (at  most  \V^\iD\{J2\'D  ele¬ 
ments)  try  each  pair  (u*+|,»'*+|)  €  V\  X  U2  (  I  U\  I  |  U2  |  pairs)  and  check 
for  each  (t  ,y )  €  A*+ |fl/  (A*+i  has  at  most  4 D2  elements)  whether 


holds.  Therefore,  given  r(Jt),  we  may  obtain  t(k+ 1)  in  time 
0  (£>2  |  V y  |  “D+  1  |  t/2  I  iD+  l)  •  Finally,  from  t(k+  1)  we  may  easily  obtain 
r(*+  1),  by  taking  a  projection  so  as  to  eliminate  uk_D+l  vk_D+l  .  This  pro¬ 
cess  may  be  repeated  (for  no  more  than  n  stages)  to  compute  r(n),  in  time 
0(nD 2  |  Uy  |  2D+l  |  (/2  j  2ZJ+I).  Then  note  that  we  have  a  YES  instance  of 
DSI  if  and  only  if  T(n)  ^  0  .  □ 

Remark:  The  algorithm  in  the  proof  of  Proposition  2.3  does  not  find  a 
satisficing  decision  rule;  it  only  determines  whether  one  exists.  However, 
satisificing  decisions  rules  may  be  computed  by  keeping  in  the  memory  some  of 
the  intermediate  results  produced  by  the  algorithm. 

Proof  of  Proposition  3,1:  Consider  the  following  problem  of  propositional 
calculus,  which  we  call  P : 

Problem  P:  We  are  given  two  sets  X  =  {xj...,zm},  •••>-»  }  °f  boolean 

variables;  a  set  D  of  (distinct)  clauses  of  the  form  x,  A  x;-  or  ~>(x,  A  Xy)  (we  assume 
that  for  any  pair  (»,/)  at  most  one  of  the  above  clauses  is  in  D);  a  collection 
{?<;  '  *  €  {l,...,m},  /€  { }}  of  non-negative  integers  and  an  integer  K.  Is 
there  a  truth  assignment  for  X  and  Z  such  that  J<K,  where 

J  =  £  7./  +  £  %  .  (A.5) 

*,  A  »,  ■  0  «,  A  -  I 

(•',/)€  A  i  («,;)€  A. 

A9  =  {(»,;):  the  clause  ->(*,•  A  *y)  is  in  £>}, 

A  j  =  {(«,;):  the  clause  (x,  A  x;)  is  in  D}* 


•  So.  J  \$  tk«  i»m  of  lb  «ti(kto  of  tko  tlum  tkot  ora  lot  uliiH 
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Lemma  A.2:  Problem  P  is  equivalent  to  DD. 

Proof;  Think  of  X,  Z  as  being  the  sets  of  observations  of  processors  5f,  S2, 
respectively.  A  truth  assignment  to  X,Z  corresponds  to  a  choice  as  to  what 
binary  message  to  transmit  to  the  fusion  center,  given  each  processor’s  observa¬ 
tion.  Let  H0  (respectively  //,)  be  the  hypothesis  that  A0  (respectively 

A,).  Finally,  view  q,y,  as  the  (unnormalized)  probability  that  the  pair  (i,j)  of 
observations  is  obtained  by  the  two  processors.  Pairs  (ij)  that  belong  to  neither 
Aa  nor  A  i  may  be  viewed  as  having  zero  probability  and  are,  therefore,  of  no 
concern.  Then,  it  is  easy  to  verify  that  J,  as  defined  by  (A.5)  is  precisely  the 
(unnormalized)  probability  of  error.  □ 

In  order  to  complete  the  proof  of  the  Proposition,  we  need  to  show  that  P  is 
NP-complete.  This  will  be  accomplished  by  reducing  to  P  the  following  (Max¬ 
imum  2-Satisfiability)  problem  of  propositional  calculus  which  is  known  to  be 
NP-complete  [2j: 

MAX-2-SAT;  Given  a  set  V  of  boolean  variables,  a  collection  C  of  (distinct) 
clauses  over  U,  such  that  each  clause  c£C  has  exactly  two  variables  and  an 
integer  A.'  <  |  C  | ,  is  there  a  truth  assignment  for  V  which  simultaneously 
satisfies  at  least  K  of  the  clauses  in  C?  (Without  loss  of  generality,  we  assume 
that  if  a  clause  is  in  C,  then  its  negation  is  not  in  C). 

Suppose  that  we  are  given  an  instance  (U,C,K)  of  MAX-2-SAT.  We  con¬ 
struct  an  instance  of  P  as  follows:  Suppose  that  U  —  {oj,. Then,  let 
i=l,...,n}  and  Z  =  2,  zi3  :«  =  .  For  each 


»  6  {!,—,«}  introduce  the  set  £>,•  of  clauses: 


"•tat  A  *,-2).  (2,2 A  2,2),  ->(il2 A  ?tl).  (*,-jA  2,2). 

-•(^.aA  *,3),  (x,3A  x,i).  (ar.iA  2,3),  (xl3A  2,-3)  . 

To  these  clauses  we  assign  the  weights  (L  is  a  large  integer  to  be  determined 
later): 

Vi  l,i  2  ~  Vi2 ,.’2  =  15L,  Vi2,il  =  ,  Vi3,i2  =  20  ^ 

Vi2,i3  =  &L,  Vi 3,1 1  —  2L,  Vi  i,i 3  —  25L,  Vi3,i3  ~  *00L 

Next,  for  each  clause  (tt,  A  «y)  ,  (->«,  A  «y)  ,  (-»«,•  A  -<tiy)  ,  (u,\/  «y )  , 
ay) ,  (-ia,V  ->ay)  in  C  (with  i  <  >),  introduce  clauses  ( ar, , A  r;|)  , 
( X, aA  *yi)  ,  (x,2A  jy2)  ,  -'(xl2A  2y2)  ,  -’(x.jA  *y2)  ,  '-(x.jA  «y,)  ,  respec¬ 
tively.  Denote  this  last  set  of  clauses  by  Dt,  and  assign  to  each  one  unit 

n 

weight.  We  now  let  D  =  (J  D[  and  observe  that  X,Z,D,{qi}- },  K  define  an 

/«= 0 

instance  of  P. 

Note  that  for  any  assignment  for  X,Z,  the  corresponding  cost  (equation 
(A.5))  may  be  decomposed  as 

J  =  J,+  t  Jl>  (A.6) 

l-l 

where  J(,  /€{0,l,...,n}  is  the  sum  of  the  weights  $y  of  the  clauses  in  Dt  which 
arc  not  satisfied. 


Lemma  A.3:  For  any  »  6  we  have  J{  =  35L  if  and  only  if  either  of 


the  following  is  true: 


(0  *,i  =  -.1  =  2,3  =  ’.3  =  1  .  J,2  =  “i2  =  0  ■ 

(«0  2,-o  =  2,2  =  2,3  =  2,3  =  1,  1,1  =  Z;i  =  o  . 

P'or  any  assignment  to  { x,j ,  z-  :  «  =  1,2,3}  other  than  the  two  assignments 
above,  J,  >  37 L. 

Proof:  By  direct  evaluation  of  Ji  for  each  possible  assignment.  See  [16].  □ 

In  view  of  Lemma  A. 3,  the  clauses  in  £>,•  and  their  associated  weights  have 
the  following  interpretation:  the  variable  ar(,  may  be  freely  assigned,  but  the 
remaining  variables  must  be  assigned  so  that  x,-2  =  x,-2  =  ~Si  —  ~'xiv  For  this 
reason  the  clauses  in  D0  are  effectively  the  same  as  the  original  set  C  of  clauses. 

Lemma  A.4:  Let  L  be  large  enough  so  that  |  C  |  <L.  Then,  there  exits  a  truth 
assignment  for  U  for  which  at  least  K  clauses  in  C  are  satisfied,  if  and  only  if 
there  exists  a  truth  assignment  for  X,Z  such  that  the  resulting  cost  J  is  less  or 
equal  than  35 nL  +  |  C  |  -  K . 

Proof:  (i)  Given  an  assignment  for  U,  with  at  least  K  clauses  satisfied,  assign 
the  variables  in  X,Z  as  follows: 

2,1  =  2 1  =  Uj,  2,2  =  Z-i  —  ->UV  1,  3  =  ;,3  =  l. 

Using  Lemma  A. 3  and  the  identity  (A. 6),  the  resulting  cost  is  35nL  (i.e.  35 /, 

from  each  collection  i  =  | ,...,«)  plus  the  number  of  clauses  in  Dg  which  are 

not  satisfied  (since  these  carry  unit  weight).  The  latter  number  is  identical  to  the 

number  of  clauses  in  ('  which  are  not  satisfied,  which  is  less  or  equal  than 

I  C  i  K. 


(ii)  Conversely,  given  an  assignment  for  X,Z  such  that  J  <  35 nL  +  \  C  \  -K, 
suppose  that  for  some  »  £  {l,...,n},  Ji  >  37 L.  Using  Lemma  A. 3  and  the  ine¬ 
quality  |  C  |  <L,  we  obtain 

J  >  E  ^  >  35nL  +  2 L  >  35 nL  +  |  C  \  -K 

i  =  i 

which  is  a  contradiction  and  shows  that  J,  =35L,  V  i.  Consequently, 
{ ■rii>Ii'2>2i i» 2}  have  been  assigned  values  in  one  of  the  two  ways  suggested  by 
Lemma  A.3.  We  now  assign  truth  values  for  U,  by  setting  «,•  =  xix.  Then  J0  is 
the  number  of  clauses  in  C  which  are  not  satisfied.  Moreover,  since 
=  35L,i  £  { l,...,n },  it  follows  that  J0  <  |  C  \  -K,  which  implies  that  at 
least  I<  clauses  in  C  are  satisfied.  This  completes  the  proof  of  Lemma  A.4. 
□ 

It  is  easy  to  see  that  the  above  reduction  of  MAX-2-SAT  to  P  is  polyno¬ 
mial.  Therefore,  P  is  NP-complete  and  so  is  DD,  thus  completing  the  proof  of 
the  proposition.  □ 
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Figure  3.1 

A  Structure  for  Decentralized  Detection 


Figure  A.1 

A  Bipartite  Graph  Consisting  of  a  Single  Cycle 


Figure  A.2 

The  Construction  of  Copies  of  the  Original  Variables 
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Figure  A. 1 


Bipartite  Graph  Consisting  of  a  Single  Cycle 


